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ABSTRACT: With today’s reports of deteriorating highways and infrastructure as 
well as increased litigation arising from structural failures and the construction 
process, there is an increasing desire to employ non-destructive testing and 
evaluation (NDTE) methods for analyzing structural concrete members as well as 
other construction materials in a noninvasive manner. A major part of NDTE 
techniques is defect characterization, which is a typical pattern classification 
problem. The current state of the art for solving this problem is the application of a 
human expert’s knowledge and experience for interpreting NDTE data. Artificial 
neural networks (ANNs) have shown a propensity for solving the pattern 
classification problem in the areas of speech and vision recognition, as well as 
problems in system modeling and simulation. As a result of these successful ANN 
applications, this paper explores the possibility of using ANNs for the NDTE defect 
characterization problem. Part of the solution of defect characterization entails the 
capability to filter what would otherwise be considered noisy data. Therefore, an 
ANN architecture is proposed and tested via computer simulation for the purpose of 
discerning between cracks and other surface defects found in photographs of 
defective reinforced concrete sections. Also, a basic introduction to ANNS is 
included along with a recommendation for continuing research. 


I. INTRODUCTION 

Reinforced concrete generally performs well as long as conditions for its 
installation and use fall within the parameters for which it was designed. 
However, there have been and always will be occasions involving severe 
construction conditions, construction mistakes, faulty design, unforeseen disasters 
such as fire and flood, and/or unanticipated loads placed on structural concrete. 
As a result of these aforementioned inauspicious circumstances, a reinforced 
concrete member will show signs of distress, i.e. cracking, dusting, scaling, 
spauling, etc. These signs of distress will require either one or some 
combination of the owner, designer, and/or constructor to investigate the 


reinforced member to determine its strength, anticipated longevity, and need for 
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replacement. Indisputably, it is ideal with respect to time and money to 
investigate the structure without doing any damage to the member; for this 
reason, non-destructive test and evaluation (NDTE) methods have become 
popular and necessary means for analyzing the integrity of structural concrete. 

Like many other scientific techniques, NDTE heavily relies on some 
expert to collect, graph, and interpret data. Certainly, there will never be an 
engineering tool which will eliminate the need for experts and good judgement. 
However, automation of NDTE methods would improve the speed of analyses 
and likely increase the frequency with which these methods are used. Ata 
minimum, NDTE automation would allow "non-experts" who become trained on 
automated NDTE systems to engage in initial data collection and defect 
classification part of the problem. 

NDTE data collection and interpretation is generally a problem in 
pattern classification, i.e. a true expert would almost instantly recognize that data 
from any given Situation fits some particular problem and solution method which 
he has before seen. However, pattern classification lends itself poorly to 
traditional computing methods. Conventional computer pattern classification has 
involved feature extraction and clustering which more often than not requires 
the use of extensive prior information, such as the statistical distribution of 


vectors. 
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In the case of NDTE data pattern classification, the computerization 
problem is compounded with the fact that the cause for and impact of defects on 
materials, like many other real world functions, is extremely complex to model, 
requires the consideration of many factors (independent variables), and is not 
completely understood. 

Enter the artificial neural network. An artificial neural network (ANN) is 
either a hardware or software system which attempts to imitate the neural 
Structure and functioning of the biological brain (Seynowski, Kock, and 
Churchland, 1988). The brain uses millions of elementary processors known as 
neurons which are interconnected by synapses and process sensory information 
(sight, sound, touch, smell, and taste), thus allowing us to perceive and ultimately 
react to our environment. Similar to its biological counterpart, an ANN is a 
massively parallel, interconnected network of simple processors which can 
receive and process many independent variables. The basic advantage of the 
ANN over other traditional serial computing techniques is the ability to take into 
account and process many independent variables much faster. 

In addition, ANNs have shown promise for successfully performing a 
variety of cognitive tasks, including statistical pattern classification. Practical 
applications of ANNs as pattern classifiers and the need for real-time response 


to real-world data have led to advances in automated speech recognition, vision 
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recognition, robotics, and other various engineering and artificial intelligence 
applications. 

NDTE defect classification is similar to the aforementioned real-world 
cognition problems for which ANNs have already been shown to have promise, 
i.e. problems requiring the processing of many independent variables and the 
classification of the result. By combining ANNs with NDTE, a significant 
improvement is expected in the consistency, accuracy, and ease of classifying 
NDTE data, 1.e., a fraction of a second to classify an x-ray image or surface 


photograph. 


Il. LITERATURE REVIEW 

Despite the initial skepticism in their applications and abilities (Minsky 
and Papert, 1969), ANNs have been shown by contemporary research as capable 
of solving a variety of engineering problems. The list of ANN applications 


includes: 
e Classification of speech sounds (Lippman, 1987), 


e Recognition of incoming military targets (Roth, 1990), 


e Formation of text-to-phoneme rules (Sejnowski and Rosenberg, 1987), 
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e Deduction of the secondary structure of a protein from its amino acid 
sequence (Qian and Sejnowski, 1988), 

e Discrimination between underwater sonar signals (Gorman and 
Sejnowski, 1988), 

© Recognition of handwriting (Weideman, Manry, and Yau, 1989), 

e Learning good moves for backgammon (Tesauro and Sejnowski, 1988), 

e Performance of nonlinear signal processing (Lippman and Beckman, 
1989; Tamura and Waibel, 1988), 

e Prediction of the amount of energy needed to modify the thermal energy 
stored in a building mass (Garret, et al, 1991), 

e Controlling the threshing module of a combine harvester (Garret, et al, 

. 1991), 
e Design of pump locations and rates of operation (Garret, et al, 1991), 
e Recognition of machining features from a CAD drawing (Garret, et al, 


1991), 


With the successes of the back-propagation neural network classifier 
(Rumelhart, McClleland, et al, 1986) and other various ANN forms, the field of 
construction engineering and management has been also been targeted as an 


area rich with potential ANN applications (Mohan, 1990). Some proposed 
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applications in construction engineering and management (Moselhi, O., Hegazy, 


T., and Fazio, P., 1991) include: 


e Predicting the bearing capacity, foundation suitability, and feasible 
dewatering methods based on geotechnical data, 

e Estimating productivity of a crew, project performance, and cost overruns 
from project environment data, 

e Determining project markup from various project data, 

e Optimizing construction schedule and resources based on historical and 
current project data, 

e Forecasting material costs as a function of various construction market 


place data. 


Another application involved the use of ANNs for land-cover 
classification of Thematic Mapper imagery (Ritter and Hepner, 1990). 

And yet another proposed application of the ANN is that of sequencing 
construction tasks (Flood, 1989 and 1990). 

A particularly interesting concept is one that explores the combination of 
the pattern classification and modeling capabilities of ANNs with the heuristic 
rules of current expert systems; this combination of Artificial Intelligence and 


ANNs has interested many researchers (Gallant, 1988; Castelaz, Angus, and 
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Mahoney, 1987,; Derthick, 1987; Fahlman and Hinton, 1986). The marriage of 
the two would provide a powerful computing tool which could not only be used 
for scheduling construction tasks, but also could assist in identifying, classifying, 
and determining the probable causation and potential solutions for defects in 
Structural concrete. 

NDTE methods require an expert to interpret highly distributed, noisy 
information for the purpose of identifying the nature, location, and causes of 
defects in materials. One example of this type of application was the use of 
ANNs for classification of eddy current signals resulting from electromagnetic 
fields generated to inspect conducting materials, such as stainless steel (Udpa 
and Udpa, 1991). The Udpas were able to successfully use a backpropagation 
trained two-layer feedforward ANN to classify the eddy current signals in terms 
of the shape and size of the defects in their test objects. In fact, they obtained 
better results with the ANN than with more traditional techniques for 
classification of such signals. 

ANNs have also been applied to the classification of signals from NDTE 
ultrasonic and sonic methods (Garret, et al, 1991). In this instance, a 
backpropagation two-layer feedforward ANN was successfully used to interpret 
data received from a pulse-echo hammer test to detect the presence of a flaw in 


a masonry wall. 
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Although some applications to NDTE techniques have been proposed 
there are many other NDTE methods which require study. In the case of 
structural concrete, NDTE can be used to determine structural concrete's in- 
place strength, uniformity of strength, cracks, delaminations, thickness, rebar 
location, depth of cover, and other discontinuities or conditions. Figure 1 
provides an overview of NDTE methods for investigating the aforementioned as 
well as other conditions ("Specialized Concrete Evaluation and Testing.", 1984). 
A summary explanation of each of the different NDTE methods used in 
examining concrete is shown in Appendix I. 

The first step in any NDTE investigation is a visual survey which includes 
observations of the surface conditions, the extent of cracking, obvious loading 
problems, settlement, poor drainage, chemical corrosion, etc. In structural 
concrete it is typically the presence of an observable physical defect which 
initiates any subsequent investigation. More times than not, the physical defect 
of concern is cracks. As can be seen by the following quote, some believe that 


cracks are extremely significant in the analysis of structural concrete members: 


"Cracks in structural concrete are like hieroglyphics-they are pictures that 


can communicate." (Gustaferro and Scott, 1990) 
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Figure 1: CONCRETE NDTE METHODS ("Specialized Concrete 
Evaluation and Testing", 1984) 


The first observations an NDTE expert makes regarding cracks in concrete is the 


orientation of the cracks with respect to the orientation of stresses on the 


member. These observations will allow the expert to use his experience to 


determine why the cracking is occurring. From this assertion, it is reasonable to 
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conclude that any automated system used to analyze cracks in reinforced 
concrete must also be able to determine what type of crack is being viewed. If 
this iS SO, the design of the automated NDTE system must include image 
processors which are able to distinguish a crack from a hole, joint, or other 
surface defect. Thus, one of the first analyses of the automated system would be 
to filter surface defects from the image of the cracked member. Therefore, we 
will investigate the application of ANNs for filtering and enhancing surface 


photographs of cracking concrete. 


HI. AIMS AND OBJECTIVES OF THE RESEARCH 
The primary objective of this research was to investigate the use of ANNs 
for the purpose of acting as a filter/enhancer for surface photographs of 
concrete structures. The filter/enhancer ANN would discriminate between 
cracks and other non-critical surface features contained in the photograph. 
In order to achieve the primary objective the following interim objectives 
were established: 
a) Review basic ANN concepts, and consider the applicability of 
ANNs to this specific problem, including state-of-the-art 
applications and research involving ANNs; 


b) Analyze the problem in terms of 
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e Investigating the types of neural architecture and training 
procedures that have potential application to the problem, 
e Collecting and/or developing sets of data for use in training 
and testing the ANN; 
c) Train the ANN designed using the data developed from the 
previous goal; 
d) Implement and evaluate the trained network on some surface 


photographs and evaluate the results. 


IV. RESEARCH METHODOLOGY 
Figure 2 shows the main stages comprising the project. 
Phase A involved a literature search to provide: 
e Insight into basic ANN architectures and training procedures, and 
e An overview of research reflecting current state-of-the-art 
applications of ANNs for data modeling and pattern classification, 
and any specific research related to the use of ANNs for the 
classification of defects from NDTE data. 
Phase B was concerned with developing data for use in training the ANN 
and design of the ANN to be used. The ANN design will be based upon the 
information gathered in Phase A. The data to be collected for training will be 


extracted from surface photographs of cracking concrete. The data was 
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Figure 2: SCHEDULE OF WORK 
imported into an IBM compatible computer with the use of a scanner. Then by 
use of software developed for the specific purpose, the training data was then 
organized and labeled. 
Phase C consisted of training and completing the design of the ANN to 
be used as a filter for the scanned in crack images. Since ANNs are relatively 
new technology, little if any hardware currently exists. Therefore, the 


development and experimentation will be undertaken using software emulation 
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of the ANNs on an IBM compatible computer. Training was completed using 
software developed by Ian Flood, the student’s faculty advisor at the University 
of Maryland, College Park, Department of Civil Engineering. 

Phase D entailed implementing and evaluating the ANN proposed and 
trained in previous phases. Evaluation was based on the subjective visual 
comparison of the filtered/enhanced image to that of the original image. In this 
case, the student developed software for the implementation of the trained 
network. 

Phase E was the culmination of the findings of this work into a final 


report. 


V. ARTIFICIAL NEURAL NETWORK BASICS 

In this section, a brief introduction is given to ANNs as relevant to this 
paper. A more detailed introduction to ANNs including the necessary elements 
of an ANN’s architecture and training procedures can be found in works by 
Other researchers (Rumelhart and McClelland, 1986; Lippman, 1989). The 
determination of an ANN architecture and training is highly problem dependent 
(Lippman, 1989; Moselhi, Hegazy, Fazio, 1990). The performance of ANNs can 
be significantly affected by the number of layers and the number of neurons in 
each layer (Rumelhart and McClelland, 1986; Huang and Lippmann, 1987, 


Gorman and Sejnowski, 1988). The network architecture and transfer functions 
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must be able to distinguish between classes of data presented to the network, be 
insensitive to slight variations in the input, and have a limited number of 
neurons to permit efficient computation and limit training data required. 
Excellent discussions regarding the types of ANN classifiers, their memory 
requirements, and performance characteristics have been written (Rumelhart, 
McClleland, et al, 1986; Lippman, 1989; Bailey and Thompson, 1990). | 
Architecture. Figure 3 is a simple three-layer network consisting of an 
input layer, a hidden layer, and an output layer. The ANN is made up of 
neurons (the nodes), and connections (the lines connecting the nodes). The 
architectures (physical configurations) of neural networks are described by the 
number of layers of neurons in the network, the number of neurons in each 
layer, and their connections with one another. There are two general classes of 
ANN architectures: 
$ feedforward, or nonrecurrent, and 
© recurrent. 
The ANN shown in Figure 3 is a feed-forward network which means the flow of 
information is in only one direction. Recurrent networks differ from feed- 
forward networks in that they contain feedback connections between layers or 
between neurons in the same layer. 
Every neuron performs both a summation function (Z) and a transfer 


function (f). Each neuron receives a set of inputs (real or discrete data) from 
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Figure 3: THREE-LAYER FEEDFORWARD NEURAL NETWORK 
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the preceding layer of neurons, with the exception of the input layer which 
receives inputs from the network’s interface with its environment. A neuron 
adds its incoming inputs together to produce a sum known as that neuron’s 
activation value, a. The activation value, a, is then operated upon by the 
neuron's transfer function, f, to produce the neuron’s output. The transfer 
function can be just about any function including the identity function. Hidden 
layer neurons commonly have a transfer function of one of the forms shown in 
Figure 4. However, the transfer function can be just about any mathematical 
form which provides an output between 0 and 1 and satisfies both the needs of 
the network and the problem being solved. Sometimes, the transfer function 
passes information out of the neuron only if a is greater than some value known 
as the threshold, t; otherwise the output of the neuron is set equal to zero. If 
the transfer function is a discrete threshold function, the output will be l if a 2 t 
and 0 if a < t. If the transfer function is continuous, the output of the neuron is 
a real number between 0 and 1. Transfer functions can also contain other 
constants such as bias,- b. Biases and the other constants position the resulting 
transfer function relative to the activation value axis. 

The output of each neuron is operated upon by the weights, w or v, on 
the connections to the next layer of neurons. The connection mathematics 
usually takes the form of a simple multiplication of the neuron’s signal by the 


connection weight, however other forms are possible. This operated upon signal 
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Figure 4 COMMON NEURON TRANSFER FUNCTIONS 





becomes the input to the next layer of neurons, or the output from the ANN to 
the environment. 

Training. Training or learning is the process of adapting the connection 
weights, thresholds, and other variables of the ANN in response to training data 
being presented to the network. The training method (or learning rule) is the 
mathematical relationship that generates an ANN's desired output for a 
particular set of inputs while setting the coefficients (b, t, w, v, etc.) in the 
neuron s local memory. 

Training can take one of three basic forms as shown in Figure 5 
(Lippman, 1989). The three types of training methods are "supervised", 
"unsupervised", and a combination of the supervised and unsupervised. 

Supervised training implies that the ANN is presented input data (called 


patterns) along with the desired output (called targets), and simply organizes its 
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Figure 55 NEURAL NETWORK TRAINING METHODS 


internal connection and transfer function parameters in order to make the actual 
ANN outputs meet the expected targets. In backpropagation training for 
example, the network cycles patterns of inputs attempting to achieve connection 
weights and neuron responses that modify the pattern of inputs to those of the 
desired targets. At the end of each cycle, the difference in the output signal and 
the desired target acts as feedback to the network to modify the connection 
weights and transfer function thresholds for the next cycle. 

Unsupervised learning allows the network to develop what are referred to 
as internal clusters from the patterns it is presented (no targets are presented), 


i.e., the network simply places its results into groupings of outputs. 
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The combination method of training allows the ANN to first organize the 
internal clusters as with the unsupervised training technique, to be followed by 
labeling the clusters with targets and sequentially retraining the network. An 
advantage of the combined training method is that it can simplify data collection 


and reduce expensive and time consuming data labeling. 


VI. APPLICATION DEVELOPMENT OF THE ANN FOR VISUAL IMAGE 
ENHANCER AND FILTER PROBLEM 
The ANN application development procedure consisted of three phases as 
shown in Figure 6: design, training (learning), and implementation and 
observation. 
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Figure 6: MAJOR PHASES OF ANN APPLICATION DEVELOPMENT 
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Design Phase. In the design phase, we first needed to analyze the 
attributes and parameters of the problem. 

Humans classify imagery by using both spectral and spatial associations 
ingrained in biological neural networks which connects their eyes to the area of 
their brain controlling vision. However for this problem, consideration of spatial 
associations was sufficient since our computerized image was a two dimensional 
image having no spectral information and consisting of an image of pixels which 
were either "on" or "off". 

The problem was then reduced to distinguishing between the two- 
dimensional image of a crack and another type of surface defect. As far as our 
computerized image was concerned, the difference between a crack and a 
surface defect was that a crack will form a continuous line of pixels that are "on" 
while a surface defect will be a few "on" pixels surrounded by "off" pixels. 

By the use of an image sampling device consisting of a pixel window (an 
array of pixels, i.e. 3 x 3, 5 x 5, 7x 7, 9 x 9, etc.) which would methodically scan 
the image, the network theoretically would be able to assimilate data of spatially 
adjacent pixels in both the training and implementation phases of this 
application. In effect we considered each element of the pixel window to be an 


input to the network with the resulting output to be a logical response, i.e. "true 


if the pixel window represents a segment of a crack or "false" otherwise. 
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For this visual filter/enhancer problem, the basic ANN paradigm chosen 


was that of a back-propagation trained feed-forward network using neuronal 


discrete threshold activation functions. The criteria for the network chosen were 


the following: 


High network accuracy 

High interpolative performance 

Since boolean input and output are desired, the transfer function should 
be one that provides either a 0 or a 1 depending on the comparison of 
the neuron’s activation value to that of some threshold. 

No incremental learning or real time performance desired 

Training time was not an issue since relatively few examples were 
expected to be used. 

Relatively low memory requirements since the amount of data generated 
by graphic images is considerable and could easily overburden or crash 


even today’s powerful desktops computers. 


Hidden layers of neurons were considered necessary because of the original 


skepticism from experiments with the neural network form known as the 


perceptron (Minsky and Papert, 1969). Although others researching the ANN 


application for NDTE data classification have used networks with two-hidden 


layers (Udpa and Udpa, 1991; Garret, et al, 1991), none have given any specific 


reasons for their choice of architecture. Some constructive proofs have 
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demonstrated that two hidden layers are sufficient to form arbitrary decision 
regions using multilayer ANNs with discrete threshold functions, while others 
have more recently shown that multi-layer ANNs with only one hidden layer 
(and no specific number of hidden neurons) could form complex disjoint and 
convex decision regions (Lippman, 1991). Since our particular problem only 
deals with a relatively simple decision region, having a value of 0 (false) or 1 
(true), only one layer of hidden neurons was considered adequate. Additionally, 
by having only one hidden layer of neurons, the training method of 
backpropagation would be able to be used to determine the correct number of 
neurons to reduce the error between actual and target outputs to zero. The 
number of hidden neurons was found by setting the parameters for the first 
neuron and cycling through the training patterns and targets until a best fit could 
be found. Then a second neuron was added to fit the errors remaining from the 
first cycle, and so on until the error is reduced to zero or some acceptable value. 
The method of scanning the image with the pixel window also became a 
factor in the application of the ANN. The scanning technique had to eii in 
such a way that the final enhanced/filtered image would be the same size as the 
original image, and at the same time avoid the loss of information. Based on 
the way the retina receives visual information, we determined each pixel window 
sample should overlap its adjacent pixel window sample. Therefore, we scanned 


the original image by starting our pixel window in the first row leftmost element 
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of the image and then moved the pixel window one pixel (element) to the right 
until the end of the image row was reached; at that point the pixel window was 
moved down to the next row and the process repeated until the last row 
rightmost element was reached. 

Our next effort in the design phase of the problem of filtering voids from 
our image involved the development of training patterns and their targets. 

We decided upon using 3 x 3 and 9 x 9 pixel window samplers for the 
experiment. The 3 x 3 sampling window represents the smallest window which 
would provide any spatially associative information. The 9 x 9 sampling window 
represents a sizeable increase over the 3 x 3 in respect to the possible number of 
combinations of pixels which could represent a crack configuration. A square 
sampling window having an odd number of elements on each side was 
considered necessary because we defined a crack image as a line of "on" pixels 
passing through the centroid of the sampling window. 

In the case of the 3 x 3 pixel sampling window, a vector with 9 elements, 
was created. Therefore the number of permutations of "on" and "off" pixels was 
2’=512. These 512 combinations were generated using a Pascal program 
PATTERNS3 as shown in Appendix II. The philosophy on assigning the target 
values was to label the target "true" for any combination of the sampling window 
which had the center pixel of the sampling window "true" and had at least two 


other pixels of the sampling window "on" but not adjacent to each other. 
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Figure 7: SAMPLE TRAINING PATTERNS FOR THE 3 X 3 
SAMPLING WINDOW 


Otherwise, the target was set to "false". A few examples of the true and false 
sampling windows are shown in Figure 7. 

In the case of the 9 x 9 sampling window, a vector with 81 elements, was 
created. Therefore the number of permutations of "on" and "off" pixels is 
2°'=2.4179 x 10%. Although this is a finite number of combinations, only fewer 
than 800 were to be used because of computer memory and speed limitations, 
and the ability of the ANNs to generalize. We used about 600 patterns. The 
600 input patterns and their respective target values were generated using the 
Pascal Program PATTERNS (APPENDIX III). In essence, PATTERNS 


randomly selects training patterns from a scanned in photograph of cracking 
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concrete and generates a visual image of the pattern on the display. Then the 
user enters the value of the target based on his subjective determination that the 
pattern shown represents a crack segment. A few examples of true and false 


sampling windows are shown in Figure 8. 


Training (Learning) Phase. Having the patterns and the target values 
established, the Pascal Program BINARYHAM (developed by I. Flood) was 
used to train the network and determine the number of neurons in the one 


hidden layer. BINARYHAM uses backpropagation as the training method and 
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Figure 8: EXAMPLE TRAINING PATTERNS FOR THE 9 X 9 
SAMPLING WINDOW 
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determines the number of neurons required to make the error between actual 
and desired outputs equal to zero. The results of the program BINARYHAM 
are a set of templates (one for each neuron in the network of the same length as 
the vector developed by the original sampling window) and a set of threshold 
values, one value for each neuron in the network. The results of the program 
BINARYHAM for the 3 x 3 sampling window are shown in APPENDIX IV and 
those for the 9 x 9 sampling window are shown in APPENDIX V. The neuron 
template elements are boolean values (O=false, 1=true). The thresholds are 
integer values which represent the required activation value of the incoming 
inputs to a neuron in order to make the network "fire". The basis for the neuron 
operation is that an incoming pattern from the image being filtered would be 
compared to a template pattern and the differences summed; if the sum of the 
differences exceeds the threshold, then the neuron would fire thereby producing 
an output of 1 (true), otherwise the output would be zero. A neuron output of 1 
(true) indicates the incoming pattern represents a segment of a crack. In 
summary, the 512 training patterns for the 3 x 3 sampling window resulted in 52 
hidden neurons, and the 600 training patterns for the 9 x 9 sampling window 
resulted in 38 neurons. Since the ANN has the ability to generalize, this 
disparity between the number of training patterns and the number of hidden 
neurons was in line with our expectations. The training time for both sets of 


input patterns was seconds using an IBM compatible 386-33MHz. 
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Implementation and Evaluation Phase. In the final phase of ANN 
application development, the templates and the thresholds developed by the 
Program BINARYHAM were recalled to form the ANN to be used. The 
program FILTER was used to scan the incoming image with the sampling 
window and to output a filtered/enhanced image. The measure of effectiveness 
of the filter/enhancer was a visual comparison between the originally scanned 
image and the ANN generated image. 

Examples of the network output using the 3 x 3 network filter are shown 
in Figure 9, and those using the 9 x 9 network filter are shown in Figure 10. 

In the case of the 3 x 3 network filter, we were able observe some meager 
filtering capabilities. Improvement was gained when the image was iteratively 
ran through the program FILTER several times. Another observation was that 
noticeable information was lost at the edge of the image and at the ends of 
crack segments. 

In the case of the 9 x 9 network filter, the filtering/enhancing capabilities 
were much greater. The 9 x 9 filter was able to eliminate large quantities of 
defects from the incoming image, however, it also deleted significant amounts of 


crack information, especially at points where cracks intersected one another. 
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ORIGINAL #2 


Figure 9: ORIGINAL VS. ANN FILTERED/ENHANCED IMAGES 
FOR THE 3 X 3 SAMPLING WINDOW 
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ANN IMAGE #1 ORIGINAL #1 





ANN IMAGE #2 ORIGINAL #2 


Figure 10: ORIGINAL VS. ANN FILTERED/ENHANDED IMAGE 
FOR 9 X 9 SAMPLING WINDOW 
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VII. CONCLUSIONS & RECOMMENDATIONS 

Conclusions from examples shown. All in all, both ANN filter/enhancers 
demonstrated the ability to successfully eliminate unwanted information from the 
original photographic images. In the case of the 3 x 3 filter/enhancer, the ANN 
demonstrated its ability to filter small pieces of noise from the image. However, 
the 3 x 3 ANN filter was limited in the size of the surface defect that it would 
effectively filter from the incoming image. Additionally, because of the way in 
which the training patterns were labeled, the 3 x 3 filter/enhancer slowly ate 
away at the tips of cracks as well as other surface defects. 

The 9 x 9 ANN filter/enhancer demonstrated greater abilities to extract 
large amounts of defect information from the image, but at the expense of losing 
pieces of the cracks. 

In both cases, the deficiencies with the ANN filter/enhancer operation 
were directly traceable to the training patterns and the image scanning 
methodology specifically used for this experiment. 

Yet, even with considering the deficiencies of the two ANN 
filter/enhancers used, this experiment validates the ability of this ANN approach 
for improving concrete crack images for the ultimate purpose of classifying the 


cracks observed. 
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Recommendations for future work for this application. A more thorough 


investigation is currently being undertaken to find a combination of different 
filters and scanning techniques which will be able to overcome the problems left 
remaining with this experiment. 

One example, would be to start with a 9 x 9 filter to eliminate large 
surface defects shown in the image, then follow with another filter which would 
subsequently complete the missing crack information. Then apply a 3 x 3 filter 
to clean-up the image. 

Another proposed solution is to use a scanning technique involving the 
use of a large sampling window where the network weights information at the 
center of the window more heavily than at the edge. 

By experimenting with different sampling window sizes, rules for 
establishing the training patterns, and various scanning techniques, this 
researcher is confident that an acceptable filter for enhancing the photographic 


images of concrete cracks can be found. 


Recommendations for future applications of ANNs to NDTE data 
modeling and classification problems. 


In the long run, we want to be able to combine the photograph 
filter/enhancer ANN with another ANN classifier which would then be used to 


classify the type of crack being studied. 
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A follow on project could be the study of ANN applications for other 
NDTE techniques (say the classification or modeling of acoustic signature 
recognition or radiography). On a grander scale, another possibility is to 
combine the crack classifier ANN with one of the other NDTE methods such as 
acoustic signature recognition to create and analyze a 3-D image of the cracked 


structural member. 


The pinnacle of research along these lines would be the development of 
hardware neural networks which could be programmed and placed in the field 


for a technician to use in quality control or investigation of structural concrete. 
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APPENDIX I. 


SPECIFIC TESTS USED TO EVALUATE 


CONCRETE(Extracted from "Specialized Concrete 
Evaluation and Testing", 1984) 


Standard methods for conducting some of the tests briefly described here are available from the 
American Society for Testing and Materials (ASTM) and the American Concrete Institute (ACI). 


These standards are noted in the descriptions 


Visual-optical: Includes visual inspection for cracks, roughness, color 
variations, corrosion, deterioration, and similar defects that can be 
detected with or without the use of optical aids such as low-power 
magnifiers. Also includes measurement of differential structural 
movements and use of fiber optics to detect internal cracks, voids or 
flaws. 


Rebound: Use of a spring-driven steel hammer to determine the 
uniformity of in-place concrete strength and to delineate zones or areas 
of poor quality or deteriorated concrete in structures. Standard test 
method is described in ASTM C 805-79. 


Pullout: Determination of the pullout strength of hardened concrete by 
measuring the force required to puli an embedded metal insert and the 
surrounding section of concrete from a concrete mass. Pullout strength 
is related to other strength test results. Standard test method described 
in ASTM C 900-82 is for situations where the metal insert is embedded in 
fresh concrete. A modification of this method permits its use even if 
inserts have not been cast in place. 


Resonant frequency: Measurement of the fundamental frequency of 
concrete for use in determining uniformity. (ASTM C 215-60 but this 
method is used primarily in laboratory tests). 


Pulse velocity: Measurement of the time of travel of a pulse or train of 
waves through concrete to determine the uniformity, to indicate changes 
in characteristics or to survey structures to estimate the severity and the 
extent of deterioration, cracking or both. (ASTM C 597-71). 


High-energy ultrasonics: Measurement of time it takes a high-energy 
pulse to travel through concrete. Used primarily to measure thickness. 


Magnetic: Use of a portable magnetic electric test device, either a cover 
meter to measure the depth of concrete cover over rebars or a 
pachometer to measure both the cover and size of reinforcing bars. 
Load testing: Application of a test load to a structure in a manner that 
stimulates the load patiern under design conditions. Test failure 
indications such as Acoustic Emission: Acoustic emission techniques 
detect, process, and record "noise" emitted by a structure that is placed 
under load. They are used primarily to detect crack growth but can also 
be used for determining the location of a crack 
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Pulse Echo: Measures velocity of a reflected pulse generated by 
mechanical impact. Detects and delineates internal discontinuities in 
concrete and, with interpretation, identifies the nature and orientation of 
the discontinuities. 


Radiographics: Use of X-rays or gamma rays, primarily to determine the 
size and location of reinforcing bars. Can also be used to detect voids or 
other flaws. 


Microwave absorption: Measurement of microwave absorption by the 
concrete to estimate the moisture content or the quality of the concrete. 


Corrosive activity: Detection of active corrosion, by methods such as 
direct measurement of current flow (half-cell potential) as described in 
ASTM C876-80. 


Chloride content: Cbloride ion monitoring by testing crushed samples of 
concrete from cores obtained in the field. 


Radar: Use of electromagnetic impulse signals to detect voids beneath 
pavements or slabs on ground or to measure siab thickness. Can also be 
used to measure size and location of reinforcement. 


Infrared Thermography: Use of selective infrared frequencies to identify 
beat patterns characteristic of certain defects. One use is to detect 


delaminations in bridge decks or pavements. 


Floor Flatness: Measurement of floor flatness using a profile graphing 
instrument or an instrument that gives digital readouts of elevation 
differences. 


Petrography: Use of microscopic examination, sometimes in combination 
with other techniques, to examine samples of concrete. Features that can 
be evaluated include denseness of cement paste, depth of carbonation, 
occurrence of bleeding, presences of leakage, excessive deflection or even 
Structural faiiure are monitored and measured visually or with detection 
devices. Procedures for load testing are described in AC] 318-83, Part 6. 
contaminating substances, air content, and other properties. Standard 
recommended practice is give in ASTM C 856-77. 
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APPENDIX II. PROGRAM PATTERN3 FOR THE DEVELOPMENT OF TRAINING 
PATTERNS FOR A 3 X 3 SAMPLING WINDOW 


program pattern_generator; 
uses dos,crt,graph; 


const 
max patterns =800; 
max_inputs=81; 
max _size4_rows= 200; 
max_size4_cols=200; 
max sizel rows=9; 
max sizel cols=9; 


type 


boolean_array_sizel =array[1..max_sizel_rows,l.max_sizel_cols] of boolean; 
boolean_array_size3 = array[1..max_patterns,1..max_inputs) of boolean; 
boolean_array_size4 = array| 1..max_size4_rows,l..max_size4_cols] of boolean; 
boolean_col_vector= array[1..max_inputs] of boolean; 


var 
criteria: byte; 
data_count: integer; 
ij,k,l,m,n,x,y: integer; 
max_pattern_count: integer; 
pattern: “boolean_array_size3; 
pattern count: integer; 
pattern_file: text; 
repeat_check byte; 
repeat count: byte; 
samp: boolean_col_ vector; 
Samp _rows,samp cols: byte; 
samples_remaining: integer; 
subj_file_name: string; 
subj_rows,subj_cols: byte; 
subj: “boolean_array_sized; 
subj file: file of boolean; 
sum: byte; 
target: byte; 
target_file: text; 


(PIE rre procedure beep Ce eee eer inc ach einen 


procedure beep; 
var 

i: byte; 

Freq: integer; 

Time: integer; 

Begin 

Freq: = 250; 

For i:= 1 to 3 do begin 
Sound(Freq); 
Time: = 250; 
Delay(Time); 
Nosound; 
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Time: = 60; 
Delay(Time) 
End; 
End; 


{seeeeeeeeeseeessesese* procedure write output ***eeterreseeseseseeoees ) 


procedure write output; 
var 
i,j,k: byte; 
begin 
k:=0; 
for i:= 1 to samp_rows do begin 
for j:= 1 to samp_cols do begin 
k=k+1; 
if pattern” [pattern_count,k] = true 
then write(pattern file,’ ’,1) 
else write(pattern_file,’ ’,0); 
end; 
end; 
writeln(pattern_file); 
writeln(target file,target); 
end; 


{ Pubes procedu re summa rizer ee } 


procedure summarizer(var sum: byte); 
var 
i,j,k: byte; 
begin 
sum: = 0; 
k:=0; 
for i:= 1 to samp_rows do begin 
for j:=1 to samp _ cols do begin 
k=k+1; 
if pattern” [pattern_count,k]= true then sum:= sum + 1; 
end; 
end; 
end; 


rre procedure sample taker ADAN GEttESt 


procedure sample _taker; 
var 
i.j,k.l,n: integer; 
begin 
randomize; 
i: = 1+random(subj_rows-samp_rows); 
randomize; 
j:= 1+ random(subj_cols-samp_cols); 
n: = 0; 
for k:=i to i+ samp _rows-1 do begin 
for l:= j to j+ samp cols-1 do begin 
n:=n+1; 
samp[n]:= subj*[k,]]; 
end; 
end; 
end; 
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ET RE EEIT procedure pattern setter ln 


procedure pattern Setter; 
var 
i,j: byte; 
k: integer; 
begin 
pattern _count:=pattern_count + 1; 
k: = 0; 
for i:= 1 to samp_rows do begin 
for j:=1 to samp_cols do begin 
k=k+1; 
pattern” [pattern_count,k]: =samp[k); 
if pattern” [pattern _count,k] =true then write(chr(176),chr(176)) 
else write(chr(178),chr(178)); 
end; 
writeln; 
end; 
writeln('Exiting pattern_setter....pattern_count:=”,pattern_count); 
end; 


dee procedure repeat checker OZI 


procedure repeat_checker(var repeat _check:byte); 
var 
i: integer; 
j,counter: byte; 
out_count: integer; 
begin 
if pattern_count=1 
then out_count:=pattern_count + 1 
else out_count:=pattern_count; 
i: = 0; 
repeat 
:=i+1l; 
counter: = 0; 
for j:=1 to samp rows*samp cols do begin 
if pattern” [ij] =samp[j] then counter: = counter + 1; 
end; 
until (counter=samp rows*samp cols) or (i=out_count); 
if counter=samp_rows*samp cols 
then repeat_check:=0 
else repeat_check:= 1; 
end; 


A target decider A e”, 


procedure target decider; 
var z 
ij: byte; 
k: integer; 
begin 
write("Time for a target decision....Enter the Target [ 0 or 1]:’); 
(beep;) 
readln(target); 
end; 
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A tarpet setter procedure PER ESET See TSeeT eee) 


procedure target setter; 
var 
midpoint: byte; 
begin 
sum: = 0; 
{ midpoint:=trunc(samp_rows*samp cols/2+0.5); 
if (pattern [pattern _count,midpoint] = false) 
then target:=0 else summarizer(sum); 
if (pattern*[pattern_count,midpoint]=true) and (sum <criteria) then target: = 0; 
if (pattern [pattern_count,midpoint] = true) and (sum > =criteria) 
then target decider; } 
target decider; 
writeln( target setter complete.....target = ",tarpet); 
readln; 
end; 


{ sl AA RE A a DA aT I IIe procedu re rotater ESEL TREO } 


procedure rotater(var pattern count:integer;ssamples_remaining:integer); 
var 

i,j,rotation_ count: byte; 

k integer; 

matrix,rotation: boolean_array sizel; 

max_rotations: byte; 


begin 


(...Set loop for max_rotations} 
if samples remaining<3 
then max_rotations: = samples_remaining 
else max_rotations: = 3; 
for rotation_count:= 1 to max_rotations do begin 


(....Set pattern to square matrix) 
k=0; 
for i:= 1 to samp_rows do begin 
for j:=1 to samp _cols do begin 
k=k+1; 
matrix[i.j]: = pattern [pattern count,k] 
end; z 
end; 


{.... fake the rotation of the square matrix} | 
for i:= 1 to samp_rows do begin 
k: = samp_rows; 
for j:= l to samp_cols do begin 
rotation[i.j]:= matrix[ ki]; 
k=k.1; 
end; 
end; 


{...Convert rotation to a new pattern} 
writeln; 
pattern_count:= pattern_count + 1; 
writeln(' In rotater, Pattern number: ”pattern_count); 
k=0; 
for :=1 to samp_rows do begin 
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for j:=1 to samp cols do begin 
k=k+ 1; 
pattern” [pattern_count,k]:= rotation[i.j]; 
if pattern” [pattern_count,k] = true then write(chr(176),chr(176)) 

else write(chr(178),chr(178)); 
end; 
writeln; 
end; 


(....set the value of Target) 
target: = target; 
write output; 
writeln( target setter complete.....target = ’,target); 
readln; 
end; 
end; 


{ wELIORELKKLLOKCSS CHC SKSEVGCSHS OO SH SHHSKK STC PEK VHS SOOVOPO CSV VS VS SKI SP SOUggerueg } 
lll ian iain ada driver program EDAD ASADAS 
{ Pee eee ) 
begin 

clrscr; 

assign(pattern_file,’pattern.dat’); 

rewrite(pattern_file); 

assign(target_file, target.dat ); 

rewrite(target_file); 


{...initialize the counter "permutations" and read in "max permutations”) 
write(’Enter maximum number of patterns desired [0..800]:', *); (beep;) 
readin(max_ pattern count); 
write(’Enter the row dimension of your sample size[3,5,7,or 9]:’,’ ’); 
(beep;) 
readln(samp_rows); 
samp_cols: = samp_rows; 
write( Enter minimum number of pixels which must be "on"); 
write(’ to set target to 1=(true):’,’ ’); (beep;) 
readln(criteria); 


{..setup and read in array to be analyzed) 
(  readln(subj_ file name);) 
subj file name: =’subjectl.dat’; 
writeln; 
assign(subj_file,subj_file_name); 
write(’What is the row and column dimensions of your training image? >); 
readln(subj_rows,subj_cols); 
{ subj rows: = 187; 
Subj cols:= 142;} 
writeln(’.....reading in the array to be analyzed.....’); 
writeln; 
reset(subj_file); 
new(subj); 
data_count: = 0; 
x: = WhereX; 
y: = WhereY; 
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for i:=1 to subj rows do begin 
for j:=1 to subj_cols do begin 
GotoXY(x,y)5 
data count:=data_count + 1; 
write("The data count =’,data_ count); 
read(subj_file,subj*[ij]); 
end; 
end; 
writeln(’.....data has been read into the program.....’); 
close(subj file); 
writeln; 


(...Determine first pattern and target} 
new(pattern); 
pattern_count: = Q; 
sample_taker; 
pattern_setter; 
target setter; 
write_output; 
{..Set up to rotate the first pattern} 
summarizer(sum); 
samples remaining: = max_pattern_count-pattern_count; 
if sum>0 then rotater(pattern_count,samples remaining); 
{..Set up main loop to find and generate new patterns} 
repeat 
repeat count: = 0; 
x: = WhereX; 
y: = WhereY; 
repeat 
sample taker; 
repeat _count:=repeat_count+ 1; 
GotoXY(x,y); 
write(’Loops in repeat check=’,repeat_count); 
repeat _checker(repeat_check); 
until repeat_check > 0; 
writeln; 
pattern setter; 
target setter; 
write output; 
summarizer(sum); 
samples_remaining: = max_pattern_count-pattern_count; 
if sum>0 then rotater(pattern count,samples remaining); 
writeln; o 5 
until pattern_count> = max_pattern_count; 
(Note the end of the program) 
writeln("The program is complete -?); 
writeln( Number of samples generated was:”,pattern_count); 
writeln; 
write? please press <enter> to return to the turbo pascal screen.’); 
{beep;} 
readin; 
dispose(pattern); 
dispose(subj); 
close(pattern_file); 
close(target_file); 
end. 
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APPENDIX Ill. PROGRAM PATTERNS FOR THE DEVELOPMENT OF TRAINING 
PATTERNS FOR A 9 X 9 SAMPLING WINDOW 


program pattern generator; 
uses dos,crt,graph; 


const 
max patterns = 800; 
max_inputs= 81; 
max_size4_rows= 200; 
max sized cols= 200; 
max _sizel rows=9,; 
max sizel cols=9; 


type 


boolean_array_sizel = array[1..max_sizel_rows,1..max_sizel_cols] of boolean; 
boolean array size3 = array[1..max_patternSs,1..max_inputs] of boolean; 
boolean array size4 =array[1..max_size4_rows,l..max_size4_ cols] of boolean; 
boolean_col_vector=array[1..max inputs] of boolean; 


var 
criteria: byte; 
data count: integer; 
ij,k,1,m,n,x,y: integer; 
max pattern_count: integer; 
pattern: “boolean_array_size3; 
pattern_count: integer; 
pattern_file: text; 
repeat_check: byte; 
repeat_count: byte; 
samp: boolean_col_vector; 
samp_rows,samp_cols: byte; 
Samples remaining: integer; 
subj file name: String; 
Subj _rows,subj cols: byte; 
subj: “boolean_array size4; 
subj file: file of boolean; 
sum: byte; 
target: byte; 
target _file: text; 


RETTET procedure beep ****+**%%0%0%000000429900099900099) 


procedure beep; 
var 

i: byte; 

Freq: integer; 

Time: integer; 

Begin 

Freq: = 250; 

For i:=1 to 3 do begin 
Sound (Freq); 
Time: = 250; 
Delay(Time); 
Nosound; 
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Time: = 60; 
Delay(Time) 
End; 
End; 


{ ce ope eae ea ga hen ee os eR oe Re procedu re write out put SHSCHSSESSSSST SS HS OSES SSS) 


procedure write output; 
var 
i j,k: byte; 
begin 
k: = 0; 
for i:=1 to samp_rows do begin 
for j:=1 to samp cols do begin 
k=k+ 1; 
if pattern” [pattern_count,k] = true 
then write(pattern file,’ ’,1) 
else write(pattern_file,’ ’,0); 
end; 
end; 
writeln(pattern_file); 
writeln(target_file,target); 
end; 


{ HPL BMS AS procedu re summarizer aa oo ) 


procedure summarizer(var sum: byte); 
var 
ijk: byte; 
begin 
sum: = 0; 
k:=0; 
for i:=1 to samp_rows do begin 
for j:=1 to samp cols do begin 
k=k+ 1; 
if pattern” [pattern_count,k] = true then sum: = sum+ 1; 
end; 
end; 
end; 


{s#eeeeeeeeeeeeesesee* Drocedure sample taker FEES TEESE E SEE EEE SE EES) 


procedure sample taker; 
var 
ij,k,l,n: integer; 
begin 
randomize; 
i: = 1 + random(subj_rows-samp_rows); 
randomize; 
j:=1+random(subj cols-samp cols); 
n: = 0; g E 
for k:=i to i+samp_rows-1 do begin 
for l:= j to j+samp cols-1 do begin 
n:=n+ 1; 
samp[n]:= subj*{k]]; 
end; 
end; 
end; 
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(arre... procedure pattern setter a 


procedure pattern_setter; 
var 
ij: byte; 
k: integer; 
begin 
pattern_count: = pattern_count+ 1; 
k: = (; 
for i:= 1 to samp_rows do begin 
for j:= 1 to samp_cols do begin 
k=k+ 1; 
pattern [pattern_count,k]:= samp|k]; 
if pattern” [pattern_count,k]= true then write(chr(176),chr(176)) 
else write(chr(178),chr(178)); 
end; 
writeln; 
end; 
writeln(’Exiting pattern setter....pattern_count: =",pattern_count); 
end; 


{#eeeeeeeeeeeseeeseeese procedure repeat checker ****e*seesesseseessess} 


procedure repeat_checker(var repeat_checicbyte); 
var 
i: integer; 
j,counter: byte; 
out count: integer; 
begin 
if pattern_count=1 
then out_count:=pattern_count+ 1 
else out_count:=pattern_count; 
i:=0; 
repeat 
iz:=i+ 1; 
counter: = 0; 
for j:=1 to samp rows*samp cols do begin 
if pattern” [i,j] =samp[j] then counter: = counter + 1; 
end; 
until (counter=samp rows*samp cols) or (i=out_count); 
if counter=samp_rows*samp cols 
then repeat check: =0 
else repeat check = 1; 
end; 


Een et target decider nr rr...) 


procedure target decider; 
var 3 
i,j: byte; 
k: integer; 
begin 
write("Time for a target decision....Enter the Target [ 0 or 1]:’); 
{beep;} 
readin(target); 
end; 
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Bere rennen target setter procedure CECESEERETS ESET CESSES ESS} 


procedure target setter; 
var 
midpoint: byte; 
begin 
sum: = 0; 
{ midpoint:=trunc(samp rows*samp cols/2+ 0.5); 
if (pattern” [pattern _count,midpoint] = false) 
then target:=0 else summarizer(sum); 
if (pattern” [pattern _count,midpoint]=true) and (sum < criteria) then target: = 0; 
if (pattern” [pattern_count,midpoint] = true) and (sum > =criteria) 
then target decider; } 
target decider; 
writeln(’target setter complete.....tarpet =’,target); 
readin; 
end; 


122222 22908000000000000% procedure rotater SOLERESS TE TETTEISEN TITTEN) 


procedure rotater(var pattern _count:integer;samples_remaining:integer); 
var 

ij,rotation count: byte; 

k integer; 

matrix,rotation: boolean array _sizel; 

max_rotations: byte; 


begin 


(....Set loop for max_rotations) 
if samples remaining <3 
then max_rotations:=samples_ remaining 
else max_rotations: = 3; 
for rotation_count:= I to max_rotations do begin 


(....Set pattern to square matrix) 
k=0; 
for i:= 1 to samp_rows do begin 
for j:=1 to samp cols do begin 
k=k+ 1; 
matrix[ ij]: = pattern [pattern count,k] 
end; 5 
end; 


{„„ Take the rotation of the square matrix} 
for i:=1 to samp_rows do begin 
k: = samp_rows; 
for j:=1 to samp cols do begin 
rotation[i,j]: = matrix[k,i]; 
k:=k-1; 
end; 
end; 


{...Convert rotation to a new pattern} 
writeln; 
pattern _count:=pattern count +1; 
writeln( In rotater, Pattern number: ”pattern_count); 
k=0; 
for i:=1 to samp _rows do begin 
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for j:=1 to samp_cols do begin 
k=k+ 1; 
pattern” |pattern_count,k]:= rotation[ij]; 
if pattern” [pattern_count,k] =true then write(chr(176),chr(176)) 

else write(chr(178),chr(178)); 
end; 
writeln; 
end; 


(....set the value of Target) 


target: = target; 

write output; 

writeln('target setter complete.....target = ’,target); 
readin; 


end; 


end; 


{ AUNAR A ++9000000009909000000000990909009044504590090000002899090900099) 


{ MRRRROMARMULYMOLOK HQQGZD GG GO driver program er 
{ vee e ses e o a e alada rra ea sae so saco so o eo ao a as ar aa ada aja e ura ada na ade a co na o ad np as rada so a aa as abs ed ed ca e es e ) 


begin 


cirser; 
assign(pattern_file,’pattern.dat’); 
rewrite(pattern_ file); 
assign(target_file,’target.dat’); 
rewrite(target file); 


-initialize the counter "permutations" and read in "max permutations" } 


write(' Enter maximum number of patterns desired [0..800]:’,’ ’); {beep;} 
readln(max_pattern_count); 

write(’Enter the row dimension of your sample size[3,5,7,or 9]:’,’ >); 
{beep;} 

readln(samp_rows); 

samp_cols: = samp_rows; 

write( Enter minimum number of pixels which must be "on"”); 

write(? to set target to 1= (true): ’); {beep;} 

readln(criteria); 


[...setup and read in array to be analyzed) 


( 


readln(subj_file_name);) 
subj_file_name: = subject1.dat'; 
writeln; 
assign(subj_file,subj_file_name); 
write("What is the row and column dimensions of your training image? >); 
readln(subj_rows,subj_cols); 
subj_rows:= 187; 
subj_cols: = 142;) 
writeln(?.....reading in the array to be analyzed.....’); 
writeln; 
reset(subj_file); 
new(subj); 
data count: = 0; 
x: = WhereX; 
y: = WhereY; 
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for i:=1 to subj rows do begin 
for j:=1 to subj cols do begin 
GotoXY (x,y); 
data count:=data_count+ 1; 
write("The data count =’,data count); 
read(subj_file,subj*[ij]); 
end; 
end; 
writeln(.....data has been read into the program.....”); 
close(subj file); 
writeln; 
{...Determine first pattern and target} 
new(pattern); 
pattern_count:=0; 
sample _taker; 
pattern_setter; 
target setter; 
write output; 


{...Set up to rotate the first pattern) 
summarizer(sum); 
Samples remaining: = max_pattern_count-pattern_count; 
if sum>0 then rotater(pattern count,samples_ remaining); 


{..Set up main loop to find and generate new patterns} 
repeat 
repeat count: =0; 
x: = WhereX; 
y: = WhereY; 
repeat 
sample _taker; 
repeat count:=repeat_ count + 1; 
GotoXY(x,y); 
write(’Loops in repeat check=’,repeat_count); 
repeat_checker(repeat_check); 
until repeat_check> 0; 
writeln; 
pattern setter; 
target setter; 
write_output; 
summarizer(sum); 
samples remaining: = max_pattern_ count-pattern_count; 
if sum>0 then rotater(pattern_count,samples_ remaining); 
writeln; 
until pattern_count> =max_pattern_count; 
(Note the end of the program) 
writeln(' The program is complete -'); 
writeln( Number of samples generated was: „pattern count); 
writeln; 7 
write( please press <enter> to return to the turbo pascal screen.?); 
{beep;} 
readin; 
dispose(pattern); 
dispose(subj); 
close(pattern_file); 
close(target file); 
end. s 
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APPENDIX IV. THE TEMPLATE FOR THE PARAMETERS OF THE 3 X 3 
SAMPLING WINDOW AS DEVELOPED BY THE PROGRAM 
BINARYHAM 


Number of Hidden Neurons= 59 Number of elements in each pattern= 9 


Patterns on each neuron of hidden layer: 


111111111 100011010 
000010000 011010100 
000010011 100110010 
111111100 011010001 
001110000 110110101 
000011100 111111100 
110010000 100011000 
000110101 000111001 
001011010 111110011 
110111011 101110111 
001010100 011111100 
010011000 011010010 
101110111 110010000 
111111110 100110100 
100010001 101011101 
001111111 011011111 
000010111 110111011 
000110110 100111000 
011110111 001110100 
010110010 010010101 
100010110 110011111 
001011001 101011000 
010010110 001010000 
111111110 000111010 
101010010 101101111 
001111111 111010111 
111101101 010110000 
101011101 

010110000 

111101111 

111101111 

101011111 


Thresholds (one for each neuron) 


45221111121186286 0110 117018627710 7118081808180 


8081818181808 


Threshold on the output neuron: 


23 
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APPENDIX V. THE TEMPLATE FOR THE PARAMETERS OF THE 9 X 9 
SAMPLING WINDOW AS DEVELOPED BY THE PROGRAM 
BINARYHAM 


Number of Hidden Neurons= 38 Number of elements in each pattern= 81 


Patterns on each neuron of hidden layer: 

000000000000000000000000000000011101111111111111111111111011000000000000000000000 
000111000000011000000111000000111100000111100000011000000011100000011100000011100 
000000000000000000000110111111111111111111111101110000000000000000000000000000000 
001110000001110000001110000000110000001111000001111000000111000000110000000111000 
000011100000011100000011100000111000001111000001111000011100000011100000011100000 
000000000111000000111110000111111000000111111000111111000000111000000000000000000 
0000000000000000000000000001 111100008 11111000111 11110000011 111000001 1111000001 1 ii 
1100001111100001 1111000111111 111110011111 1100111110000001110000001110000001110000 
000000011000000111000001111000011111000111110000111100000111000000111000000111000 
000000111100001110111111110111111100111111100110000000111000000000000000000000000 
111110000111100000111110000111111000111111100110011111110011111000000111000001111 
001111110001111100001011100000011100000011100000011110000011111000000111000000001 
101111000001110000101110000111110000111110000111110000111111000111111000000111000 
011111101011111000011111111111111111111111111111000001000000000000000000000000000 
000001111000001:11100001111:000111101101111100111110000111110000111111100111111100 
111111111111111111111100111111100111111110011111111000111111110111111111111011111 
000000000000000000000000111000000011001111111001111111011111111011100001111000000 
000011:1110000111111111111001111111001111111000000011 1000000111 100000001100000001 1 
111100000111100000111:1110000001110000000111:1000011111100011111111111100111111100 
000000000000000000000000000110000000111110011111111111111111111000111010001111000 
111111111111111111111111111111111111111111111111111111111111111111111111111111111 
11000111110000111000001111000001:11000000111000000111001100111001 1111110000001 1100 
111001111111000111111111111111111111111111111100111111100111111100011111100011111 
00111111100111111111111000111111000011111000000011100000011111 10000011 11000001111 
111111111111111111110000011:110000011110000011110000011110000011111111111111111111 
I111111111111111111100000111100000111100000111100000:1110000011111111111111111111 
011110001001110011001111110001111100011110000011110000111100000111000000111111000 
1111111110000111110000:11111001111100111111100111111101111111111111111111111111111 
1110000001111100011111:1111:101111111100111111100001100000001100000000110000000011 
11111111111111111111111111111111111100000011::1000000111000000:11:110000111110000111 
00001110000001111000000110000000111100001111:1000011111000011101000111100000111 100 
011111111000000011000000001000000000011110000011111000111111100111111110111111111 
011000011011000001010000000010000000111111100111111111111111111000000111000000001 
110000111111000111111100011111110011111110011111110011111110011110000111000000111 
00001:1100000011100000011111001111111001111111111100011111000011111000011111000111 
111000001110000011100000111100001111100011111100011111100011111100011111000000111 
100000000111000000111110000011110000001110000001110000001110100001111100011111100 
011111111011111111001111110001111100001111000000000000110000011111111111111111111 


Thresholds on each hidden neuron: 
19 19 18 18 23 23 18 18 18 14 15 14 17 17 15 59 14 17 19 12 21 20 80 19 80 80 20 80 20 80 12 80 20 80 19 80 14 80 


Threshold on output neuron: 
10 
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APPENDIX VI. NOTATION. 


Activation value of a neuron 

bias. This value determines the lateral placement of the sigmoid transfer 
function with respect to the axis of the dependent variable(s). 

threshold value for a transfer function 

connection constants, i.e., weights, offsets, etc. 

Symbol for the transfer function of a neuron 

Summation 


Z 2 


Msn 
z 
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